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We study synchronization of non-diffusively coupled map networks with arbitrary network topolo- 
gies, where the connections between different units are, in general, not symmetric and can carry 
both positive and negative weights. We show that, in contrast to diffusively coupled networks, the 
synchronous behavior of a non-diffusively coupled network can be dramatically different from the 
behavior of its constituent units. In particular, we show that chaos can emerge as synchronized be- 
havior although the dynamics of individual units are very simple. Conversely, individually chaotic 
units can display simple behavior when the network synchronizes. We give a synchronization cri- 
terion that depends on the spectrum of the generalized graph Laplacian, as well as the dynamical 
properties of the individual units and the interaction function. This general result will be applied to 
coupled systems of tent and logistic maps and to two models of neuronal dynamics. Our approach 
yields an analytical understanding of how simple model neurons can produce complex collective 
behavior through the coordination of their actions. 

PACS numbers: 05.45.-a, 05.45.Xt, 87.19.1j 



INTRODUCTION 

Dynamical processes in networks, such as synchroniza- 
tion, have been attracting much interest 

A aim. a 

striking characteristic of many networks is that they are 
often formed from very simple units {e.g. a neuron cither 
spikes or is silent, at a certain level of description) but 
can collectively exhibit a wide range of dynamics. A cen- 
tral question is then how dynamically simple units can 
produce rich collective dynamical behavior when they are 
coupled together in a network. In this letter we offer a 
solution to this question in the context of synchronization 
of coupled map networks. 

Previous work on synchronization of coupled maps fo- 
cused on diffusive coupling with non-negative weights. 
However, in diffusively-coupled networks the synchro- 
nized network shows the same dynamical behavior as 
one single isolated unit; thus, no new collective behav- 
ior is emerging here. New collective behavior could, for 
instance, be produced by time delays, which may remark- 
ably make it easier for networks to synchronize 0, 0| • 

Here however, instead of time delays, we consider non- 
diffusive coupling schemes. One particular non-diffusive 
coupling scheme, the so-called direct coup ling scheme is 
motivated by biological findings (see [10( and the refer- 
ences therein) and has been used in studies of amplitude 
response of coupled oscillators Q, although not inves- 
tigated as extensively as diffusive coupling in synchro- 
nization research. In this letter, we use a direct cou- 
pling scheme to study the emergence of new collective 
dynamical behavior. In particular, we show the emer- 



gence of synchronized chaotic behavior in a network of 
non-chaotic units. To our knowledge this is the first 
time that such a phenomenon is observed and analyzed 
in depth in mathematical network models. In contrast, 
synchronized chaotic behavior in a network of chaotic 
units 13, 1 17] and non-synchronized chaotic behavior in 



a network of non-chaotic units [14j are well established 
phenomena. 

A further feature of this work is that we take the suc- 
ceeding, typically in the literature neglected, facts into 
account. Many biological networks share the following 
two properties 10]: (i) The connection structure is, in 
general, not symmetric, (ii) The influence of neighboring 
units can be excitatory or inhibitory, which is modelled 
by positive and negative weights. It is thus essential to 
incorporate these characteristics in network models in or- 
der to understand the dynamical behavior of biological 
networks. Consequently, we consider networks with ar- 
bitrary network topologies, namely, not necessarily sym- 
metrically coupled networks with possibly both positive 
and negative weights. On the other hand, we restrict our- 
selves to networks of identical units. We mention, e.g., 
21], as a recent study of diffusively-coupled units with 
small parametric variations. 

In order to emphasize a general aspect, we consider 
in the next section networks with pairwise coupling and 
present a general synchronization criterion. Later on, we 
will focus on directly coupled networks and study the 
emergence of new behavior. 
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PAIRWISE COUPLING 

In our coupled map network model, each node is a 
dynamical system whose evolution is described in discrete 
time t by iterations of a scalar map /, i.e. by an equation 
of the form 

x(t + l)=f(x(t)). (1) 

The interconnections are specified by a weighted, directed 
graph r on n vertices. The weight Wij of the connection 
from vertex j to vertex i can be positive, negative or 
zero. We assume that the network has no self-loops, that 
is, wu — for all i. The in-degree of vertex i is rfj = 
y^j—x j23i]. The activity at vertex or unit i at time 
t + 1 is given by: 

n 

Xi (t + 1) = f(xi(t)) + -^-J2 w ij9(xi(t),Xj(t)), (2) 

i = 1, ...,n, 

where / : M — > R and g : M 2 — > M are differentiable func- 
tions with bounded derivatives, and e £ 1 is the overall 
coupling strength. The function / describes the dynami- 
cal behavior of the individual units whereas g character- 
izes the interactions between different pairs of units. 



SYNCHRONIZATION 

We are interested in synchronized solutions of eq. ([2"]l. 
where the activity of all units is identical, that is, Xi(t) = 
s(t) for all i and t. It follows from eq. ([2]) that a synchro- 
nized solution s(t) satisfies 

s(t + l)=f(s(t)) + eg(s(t),s(t)). (3) 

This equation already shows that the synchronized solu- 
tion s(t) can be quite different from the dynamical be- 
havior of an isolated unit described by /. By contrast, 
in diffusive-type coupling, i.e. g(x,x) — for all x, the 
interaction g vanishes when the network is synchronized; 
therefore, the synchronized solution is identical to the 
behavior of the individual units, and no new dynamics 
can emerge from synchronization. 

Before we explore different examples of new collective 
behavior, we investigate the robustness of the synchro- 
nized state against perturbations. The network is said to 
(locally) synchronize if lim^oo \xi(t) — Xj(t)\ — for all 
i, j starting from initial conditions in some appropriate 
open set[24|. The propensity of the network to synchro- 
nize depends on the properties of the functions / and g 
and the underlying network structure. The latter can be 
encoded in terms of the eigenvalues of the graph Lapla- 



cian C for directed weighted graphs, defined as [B[ 

{1 if i = j and di ^ 0. 

Wij if there is a directed edge . . 

~ from j to i and d t ^0. ^ ' 

otherwise. 

We label the eigenvalues of C as Ai,...,A„. Since we 
assume that the in-degrees are non-zero, we may write 
C = I — D _1 W, where I is the (n x n) identity matrix, 
D = diag{<ii, d n } is the diagonal matrix of vertex in- 
degrees and W = (wij)"- =1 is the weighted adjacency 
matrix of the underlying graph. Zero is always an eigen- 
value of £; we denote it Ai = 0, and U\ = (1, . . . , 1) T is 
the corresponding eigenvector. 

Since all components of u± are identical, perturbations 
along the Mi-direction again yield a synchronous solu- 
tion. To study the remaining directions, we define the 
k-th mixed transverse exponent Xk f° r 2 < k < n as: 

^ t+T-l 

Xk ■= limr^oo- l°g|M s (*))l) ( 5 ) 

where 

hk(s(t)) = f'(s(t)) + edig(s(t),s(t)) 
+ed 2 g(s(t),s(t))(l-X k ) 

and dig denotes the ith partial derivative of g and t is 
chosen such that h(s(t)) ^ for all t > t. If no such 
i exists we set Xk = — oo. Note that these exponents 
are evaluated along the synchronous solution ([3]). They 
combine the dynamical behavior of the individual units 
and the interaction function with the network topology. 
The maximal mixed transverse exponent governs the syn- 
chronizability of the network, that is, system ([2]) locally 
synchronizes if 

X := maxxfc < 0. (6) 

k>2 

This result is rigorously derived in our companion paper 

DIFFUSIVE AND DIRECT COUPLING 

In the sequel, we restrict ourselves to functions g : K — > 
K. When g(xi,Xj) — g(xj), pairwise coupling reduces to 
direct coupling, i.e., 

n 

Xi{t+l)=f{x i (t))+^-y2w ij g(x j (t)), * = l,...,n (7) 
and the mixed transverse exponent ([5]) reduces to 
X d r ct := lim I £ log\f'(s(t)) + eg'(s(t))(l-X k )\. 

s=t 

(8) 
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By rearranging terms on the right hand side in (J7]) as 



COUPLED TENT MAPS 



f(x t (t)) + eg(x l (t)) + jY, w ^^(t))-g(Mt))), (9) 

1 3 = 1 

this becomes formally equivalent to a system of the form 

n 

x t (t + l) = <f>(Xi{t)) + ^-^2w ij 'Y{x j (t),x i (t)), (10) 
dl j=i 

with j(x, x) = for all X, 1.6.. cl diffusively coupled map 
network. Thus, the conditions for synchronization of di- 
rectly coupled networks can be deduced from the dif- 
fusive coupling case (fTO]) of 18]. However, the formal 
equivalence obscures the roles of the system parameters 
and the particular coupling functions, which are impor- 
tant in applications. For instance, in neuronal networks, 
gap junctions at electrical synapses provide connections 
of diffusive type, whereas chemical synapses provide con- 
nections with direct coupling. The distinction is cru- 
cial for understanding the effects of different types of 
synapses. As already mentioned, diffusively-coupled net- 
works have been widely studied. For the remainder of 
this work, we restrict ourselves to direct coupling. 

The definition of x* rect intertwines the effects of the 
resulting synchronized dynamics and the network topol- 
ogy. However, if g is a multiple of /, i.e. g — cf for 
some constant c, then these effects can be separated as 
the synchronization condition ([6]) takes the form 



max log 

fc>2 



1 + ec 



+ M(l+ec)/ < 



(11) 



where 



M(i+tc)/ : = limT-^oo^ 



^ t+T-l 
J 1 

s=i 



log|(l + eC )/'( S (t))| (12) 



is the Lyapunov exponent of (1 + ec)f(x). Here t is cho- 
sen such that f'(s(t)) ^ for all t > t. In the sequel, let 
27(c, r) denote the disk in the complex plane centered at 
c having radius r. It is easy to see that (fTTj) is equiva- 
lent to the condition that all eigenvalues, except Ai, are 
contained in D(c*,r*), where 



ec 



and 



r* = |c*|exp(-/i( 1+ec)/ ). 



(13) 



(14) 



If, for example, the synchronized solution (1 + ec)f(x) 
is chaotic (i.e. has a positive Lyapunov exponent), then 
the first term in (fTTj) has to be sufficiently negative to 
compensate the positive Lyapunov exponent in order to 
ensure that the system ([7]) locally synchronizes. This 
in turn requires that the eigenvalues for k > 2 be 
bounded away from zero, and the coupling strength e lie 
in an appropriate interval. 



Before turning to biologically motivated functions / 
and g, we demonstrate the emergence of synchronized 
chaotic behavior for the case of the tent map where an 
analytical treatment is possible. The tent map is given 
by ' 



T p (x) 



px, 
P(l 



if x < h 



x), if x > 



(15) 



for p G [0,2]. Its Lyapunov exponent is logp; thus, it is 
chaotic for p > 1. Let f(x) = T a (x) and g(x) = T&(x) 
with < a, b < 2 and choose the coupling constant e = 
(t — a)/b. By choosing different values for the target 
value r we can generate different synchronized dynamical 
behavior s(t + 1) = T T (s(t)) whose Lyapunov exponent 
equals logr. Since the absolute value of the derivative of 
T T (x) is constant, from (ITU we have that the system ([7]) 
locally synchronizes if 



(r - o)Afc| < 1, 



(16) 



for k = 2, n. For example, for r = 2 and a = b = 1/2, 
the synchronized dynamics is chaotic although the indi- 
vidual units are not. Furthermore, in this case condition 
(fT"6| is satisfied if all eigenvalues of the graph Laplacian, 
except Ai, are contained in 17(4/3,2/3). 



SYNCHRONIZED CHAOS IN NEURONAL 
NETWORKS 

We now apply the foregoing ideas to models of neu- 
ronal networks. 

We point out that the equations usually considered in 
neural network theory, 

Vi(t + 1) = f ^yi(t) + j^Wijtpiyjit))^ ; i= l,...,n, 

(17) 

can be derived from (J7J with ip — g o f 1 and Ui(t) — 
f(xi(t)). Thus the dynamics of yi(t) are determined by 
the dynamics of Xi (t) and hence our results also apply to 
networks given in the form (1171) . 

A neuronal network consists of neurons linked by 
synaptic connections, which are directed and weighted. 
For an excitatory synapse the weight is positive, and the 
presynaptic neuron increases the activity of the postsy- 
naptic neuron according to its weight, whereas for an in- 
hibitory one the weight is negative, and the postsynaptic 
activity is decreased. 



Leaky neuron model 

In this model, the individual dynamics is governed by 
(UJ with f(x) = jx + O, where 7 € (0, 1) represents dis- 
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FIG. 1: Lyapunov exponent of eq. 1)180 for the parameter 
values 7 = 0.3, k = 20, 6 = 4. 



sipation and is a bias term, which could also include 
e.g. an external input. The interactions between the neu- 
rons are modeled by the sigmoidal function g{x) = a K (x), 
where 



1 



1 



1 + exp(— kx) 2' 
with k > 0. The resulting synchronized solution satisfies 



s(t + 1) = js(t) + 6 + ea K (s(t)). 



(18) 



This is a generalization of the dynamics considered for 



k = 1 in 



16] 



In fig. Q] the Lyapunov exponent of eq. ((15)) 
is plotted for a set of parameter values. Although the 
dynamical behavior of the individual units is very simple 
(there is a globally attracting fixed point), the collec- 
tive behavior can be non-trivial and even chaotic. Note 
that dynamical behavior can be controlled by varying the 
coupling coefficient e. We now fix e = —8 so that the syn- 
chronized behavior is chaotic. In fig. [2] the mixed trans- 
verse exponent x is plotted as a function of A, which is 
here taken to be real for simplicity of graphical depiction. 
The figure shows that the network locally synchronizes if 
approximately 



0.4 < A fc < 1.3 for k > 2, 



(19) 



since in that case Xfc < for all k > 2. We illustrate the 
dynamics in an all-to-all coupled network of leaky neu- 
rons. The eigenvalues fall into the range given by (|19p 
when n > 4. To see this, recall [9j that the Laplacian of 
an all-to-all coupled network on n units has one eigen- 
value equal to zero and all other eigenvalues equal to 



A fc = n/(n - 1), fc>2. 



(20) 



Hence, globally coupled networks having more than four 
vertices should synchronize to a common trajectory, 
which, according to fig. (U is chaotic, whereas smaller 
networks do not synchronize. This is confirmed by the 
simulation results of fig. EI 



FIG. 2: Mixed transverse exponent x as a function of A for 
the dynamics (118)1 and the parameter values 7 = 0.3, k = 20, 
9 = 4, e = -8. 



(a) n = 4 




(b) n = 5 




FIG. 3: Dynamics of all-to-all coupled leaky neurons starting 
from random initial conditions. The 4-neuron system (a) does 
not synchronize, but the dynamics remain simple, whereas 
the 5-neuron system (b) synchronizes, and the synchronous 
solution is chaotic. The parameter values are as in fig. [2] 



Sigmoidal neuron model 

As a second model of a neuronal network we consider 
a sigmoidal neuron dynamics with f(x) — <r a (x). In this 
case the neuron behaves like one with bias term. We take 
the interactions between the neurons to be also given 
by a sigmoidal function g(x) — ap(x). The resulting 
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FIG. 4: Bifurcation diagram of (121|) for the parameter values 
a = 100,/? = 20. 



synchronized dynamics satisfies 

s(t + l) = a a {s{t)) + ea (s{t)). (21) 

For the special case e = — 1, the dynamics of eq. (l2~Tj) has 
been analytically shown to be chaotic if a > 2/3 [22| . Here 
we consider a whole range of e-values. The bifurcation 
diagram of eq. (|2"Tj) is plotted in fig.SJ for a set of parame- 
ter values. It is seen that the dynamics has a complicated 
dependence on e, and there are many regions of chaotic 
behavior interspersed with periodic windows. In fig. [5] 
the mixed transverse exponent % is plotted as a function 
of the complex eigenvalue A, where the blue color shows 
regions of synchronization. Figure [6] shows the onset of 
synchronization to chaos in a random directed network 
of 100 sigmoidal neurons, where the probability of a di- 
rected link from a vertex to another is taken to be 0.25 
for a positive link and 0.01 for a negative link. As in 
the leaky neuron model, monotonic individual dynamics 
is replaced by collective chaotic behavior, this time in a 
random directed network having both excitatory and in- 
hibitory links. By adjusting the global coupling strength 
e, one can observe a wide variety of synchronized dynam- 
ical behavior. 



SUPPRESSION OF CHAOS VIA 
SYNCHRONIZATION 

Besides the emergence of chaos in networks of simple 
units, our theory can also be used to show the possibility 
of simple synchronous dynamics in a network of chaotic 
units. In other words, chaos is replaced by simpler be- 
havior in the network. The field of chaos control is exten- 
sive and includes several well-established methods; for an 
overview see [1(3] and the references therein. In our case, 
the network achieves chaos suppression through synchro- 
nization of its units. 
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FIG. 5: The mixed transverse exponent \ as a function of 
A for the dynamics (|2ip and the parameter values a — 100, 
ft = 20, e = — 1. Blue indicates negatives values of \ and red 
positives values, respectively. 
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FIG. 6: Dynamics of a random directed network of 100 
sigmoidal neurons with both positive and negative weights, 
showing synchronization to a chaotic trajectory starting from 
random initial conditions. Parameter values are as in fig. [5] 

As an example we study chaos suppression in a network 
of coupled chaotic logistic maps. It is well-known that the 
logistic map 

£ p {x) = px(l-x), p G [0,4] and x G [0,1], (22) 

undergoes a period doubling route to chaos as the pa- 
rameter p is increased from to 4 ll]. In the sequel 
we will consider two different values for the parameter 
p. For p = 2.5 the logistic map possesses an attract- 
ing fixed point and the Lyapunov exponent is given by 
pi 2 5 = — In 2. Thus £2.5(x) is dynamically simple. On 
the other hand for p = 4 the logistic map is maximally 
chaotic with a Lyapunov exponent pg 4 = In 2. 

Consider a network of chaotic logistic maps, with 
fix) — g(x) — 4x(l — x) and e = —3/8. In this case the 
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synchronous solution is given by s(t) = £2,s(t). So the 
whole synchronized network displays simple dynamical 
behavior, although all units in the network are chaotic. 
It follows from (fTBf and (fT4")) that the network synchro- 
nizes if all eigenvalues Xk, for k > 2, are contained in 
P(-5/3,10/3). 



SYNCHRONIZATION CONDITION WITHOUT 
EIGENVALUE CALCULATIONS 

As we have seen, the synchronous solution can be sim- 
ple although all units of the network are chaotic. In 
this case it is possible to state a sufficient condition for 
synchronization without the explicit calculation of the 
Laplacian eigenvalues. It follows from Gershgorin's disk 
theorem [l2| that all eigenvalues of C are contained in 
T>(1, r), where 25] 



max ■ 



(23) 



On the other hand, by (|T3[) and (|T4l) . the system synchro- 
nizes if all eigenvalues for k > 2, of C are contained 
in X>(c* , r*). Consequently, a sufficient condition for syn- 
chronization is given by 



2?(l,r) C V(c*,', 



(24) 



We consider the case where g(x) = cf{x). In [6| we prove 
that jUJ holds if and only if 



M(l+ec)/ < ^g 



l + ec 



1 + \ec\r 



(25) 



Note that ([25]) can only be satisfied if the resulting syn- 
chronous behavior is not chaotic, since the right-hand- 
side of (|2"5"j) is non-positive. Hence, if the synchronized 
solution s(t) is not chaotic, it is possible to use the spec- 
tral bound r, instead of the whole spectrum of L, to give 
a sufficient condition for synchronization. The advan- 
tage is that from (|23|) one can immediately estimate the 
effect of changing the network weights without lengthy 
eigenvalue calculations. 



DISCUSSION 

In diffusively-coupled networks, the whole synchro- 
nized network displays the same behavior as any single 
individual unit; hence, complex behavior cannot emerge 
through synchronization of dynamically simple units. In 
contrast, as we have shown in this letter, the direct- 
coupling scheme leads to new collective dynamical be- 
havior when the network synchronizes. We have given 
an analytical condition for synchronization in terms of 
the spectrum of the generalized graph Laplacian and the 



dynamical properties of the individual units and coupling 
functions. In particular, we have shown that synchronous 
chaotic behavior can emerge in networks of simple units, 
and conversely, chaos can be suppressed in networks of 
chaotic units through synchronization. These results rep- 
resent a further step towards answering a fundamental 
question in complexity, namely, how complex collective 
behavior emerges in networks of simple units. 

The setting presented here allows for studying synchro- 
nization in general network architectures. Such general- 
ity is important for applications because the connection 
structure of many real-world networks is unidirectional 
and the influence of neighboring units can be excitatory 
or inhibitory, as in neuronal networks. We have applied 
our theoretical findings to two neuronal network models, 
and have shown that, by changing a single parameter 
such as the coupling constant, the network can exhibit 
quite a rich range of dynamical behavior in its synchro- 
nized state. The results presented here provide insight on 
how new dynamical behavior may be induced in neuronal 
networks by changing the synaptic coupling strengths in 
a learning process. 
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